method and apparatus for detecting actuation of a controller 

Device on a Touch Screen 



Reference to Related Application 

This application is a continuation-in-part of Unites States Patent 
Application serial no .09/670,6 10, filed 09/26/2000, for which priority is claimed. 



Background of the Invention 

10 

The patent application referenced above is incorporated herein by 
reference, particularly Figures 1 1 , 12A-12F, 16, 17, 26, and 31-34 and the 
descriptions related thereto on pages 21-24, 26, 32-33, and 37-41 in the 
specification. This application describes, inter alia, the use of physical control 

15 devices that may be applied to a resistive-type touch screen to emulate 

mechanical control devices such as knobs, faders, joysticks, and mouse devices, 
provoking touch detections that are interpreted by software as control 
movements of the control devices. These touch detections are generally located 
within a screen area adjacent to the control device base, which is adhered to the 

20 outer surface of the touch screen. 

It has been observed that the locus of the touch detections provoked by a 
physical control device is not confined within the outline of the base of the 
control device. When a control device such as a post is operated on the surface 
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of a resistive touch screen, it presses on singular points of the touch screen, those 
points extending along the perimeter of the base of the post The locus of these 
touch points is generally a closed curved shape that is roughly centered with 
respect to the base of the post. It has been observed, however, that a certain 

5 amount of these touch detections are located outside the perimeter of the base, 
and may be spaced therefrom at a not insignificant distance. Thus a control 
device such as a post may generate touch detections at some distance from its 
location on the screen. 

This distant touch phenomenon may be problematic when the control 

10 device is combined with on-screen active devices such as switches or other touch 
sensitive control areas that are actuated by a finger touch, stylus touch, or the 
like. For example, as shown in Figure 1 , a knob controller 1 1 comprised of a post 
may be joined to a resistive touch screen 12 to provoke touch inputs to the 
screen 12, and these touch inputs may be recognized as knob rotation, joystick 

15 directional movements, or mouse movements. In any case, fingertip operation of 
the controller 1 1 involves pressure applied through the perimeter of the base of 
the post that tends to generate closed curved loci 13 of touch detection points. 
Note that some of these closed curved loci 13 are spaced outwardly from the 
controller 1 1 . 

20 Generally the controller 1 1 is employed in combination with one or more 

virtual displayed devices portrayed on the display that is associated with the 
touch screen 12. Each virtual displayed device corresponds to a respective area 
on the touch screen, and any touch within that area is interpreted as a command 
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to actuate the virtual displayed device. For example, a switch 14 may be placed 
proximate to the controller 1 1 ,and the switch may or may not have a function that 
interacts with the controller 1 1 . However, it is clear from the fact that one or more 
locus of possible touch points of the controller 1 1 extends to intersect the touch 
5 sensitive area of the switch 14. Thus it is possible for a touch detection of knob 
controller 1 1 to generate a false touch command at the switch 14. 

This potential problem could be solved by software that turns on and off 
the touch detection associated with physical control devices such as controller 11 
and selectively ignore touch detections within some default distance of the 

10 physical controller. This solution would require a user to switch constantly 
between two modes: physical control devices enabled and virtual displayed 
devices disabled, and vice versa. This requirement is not consonant with an 
underlying concept of the invention, which seeks to provide seamless interaction 
between the devices displayed virtual displayed devices and the physical devices 

15 adhered to the touch screen. 
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Summary of the Invention 

The present invention generally comprises a system for eliminating any 
ambiguity in the touch detection of virtual displayed devices and physical 
5 devices operatively associated with a touch screen. The system of the invention 
operates interactively with a resistive touch screen, and is directed toward 
detecting that any physical control device applied to the touch screen has been 
touched, and then notifying the touch screen system. One purpose of the 
invention is to utilize the notification signal to indicate that any of the physical 

10 devices on the touch screen have been touched, and to automatically turn ON all 
the physical devices on the touch screen. Generally, the physical devices are 
turned ON when any one of them is touched, and are turned OFF whenever the 
touch is removed. The notification signal enables the touch screen system to 
interpret correctly a touch on the screen directly (by finger or stylus), and to 

15 eliminate confusion caused by touch detections generated by a physical device. 
Thus, referring to the example of Figure 1 , a knob controller 1 1 cannot 
accidentally cause actuation of a switch 14 portrayed on the screen display, since 
the act of touching the controller 1 1 activates the controller 1 1 and deactivates 
the virtual displayed devices displayed on the screen. 

20 The invention generally consists of a transponder circuit that is 

incorporated in a physical control device applied to a resistive touch screen. An 
antenna is arranged to extend about the perimeter of the resistive touch screen, 
and the antenna is fed an AC input signal at a known frequency. Each physical 
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control device is provided with a resonant antenna tuned approximately to the 
frequency radiated by the perimeter antenna, the resonant antenna including a 
tuned LC tank circuit. A simple switch on each physical control device is used to 
switch on the resonant antenna only when the physical control device is touched 

5 by the user. The AC signal fed to the perimeter antenna may comprise a square 
wave having periodic OFF states, and the perimeter antenna serves as a pickup 
system for signals radiated by the resonant antenna of any physical control 
device. Whenever the perimeter antenna receives a signal from a resonant 
antenna of a physical control device during the OFF periods of the input signal, 

10 the system sends a response signal to the touch screen system to apprise it of the 
fact that a physical control device is being operated, and that virtual (displayed) 
control devices should be turned OFF while the touch input from the physical 
control device is received by the touch screen. 

The physical control device may comprise a post having a base portion 

15 adapted to be removably adhered to the touch screen, and a stem portion 
extending coaxially from the base portion. Within the base portion, there is 
secured a coil (helical or spiral) that forms the inductor portion of the LC resonant 
antenna. A capacitor is housed within the stem portion of the post, and 
conductors connected to the coil and capacitor lead to finger touch pads on the 

20 outer top surface of the stem. The touch pads are arranged so that any finger 
touch on the top surface of the post will bridge two or more touch pads and 
complete the circuit between the inductor and capacitor, thereby enabling the LC 
antenna to couple resonantly to the AC field radiated by the perimeter antenna. 
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In a further, generalized embodiment of the invention, the response signal 
generated by touching the physical controller device may be correlated with a 
touch detection signal from the touch screen assembly to form a useful combined 
entry to the host computer system associated with the touch screen. For example, 
5 when a post is first placed on a touch screen, the touch screen generates a touch 
detection at the point (or area) of placement, and the post generates a response 
signal as described above. The coincidence of these signals may be interpreted 
by the host computer system, for example, as an indication that the user has 
installed the post at the touch detection area. 

10 In an alternative embodiment of the invention, the LC resonant antenna 

described above may be incorporated in a pen or stylus wielded by a touch 
screen user. In this embodiment the response signal from the resonant antenna is 
not necessarily used to enable physical control devices while disabling other on- 
screen touch detections. Rather, the pen is provided with a touch pad area on 

15 the outer surface thereof, the touch pad area disposed to be selectively touched 
by a finger tip of the user. A finger touch on the touch pad area completes a 
circuit between an inductor and capacitor within the pen, thereby enabling the 
LC antenna to couple resonantly to the AC field radiated by the perimeter 
antenna. The resonant antenna output is received and interpreted by the system 

20 as an input to the host computer system that is associated with the touch screen 
system. This input may be used as a mouse click input, whereby the user may use 
the pen to touch and select a portion of the display associated with the touch 
screen, while simultaneously entering a mouse click (or double click). 
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As an adjunct to the alternative embodiment, the pen may be provided 
with a movable cover member adapted to selectively disable the touch pad 
portion of the pen. The movable cover may comprise a sleeve-like member 
secured about the pen, with an opening in the sleeve that permits access to the 
5 touch pad area. The cover is rotatable about or movable along the pen, whereby 
the opening may be moved into non-registration with the touch pad area to 
prevent a finger touch on the touch pad area, so that accidental mouse click 
inputs are blocked. 
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Brief Description of the Drawing 

Figure 1 is a plan view of a touch screen assembly known in the prior art, 
illustrating a problematic touch screen characteristic. 

5 

Figure 2 is a perspective view of a post physical controller of the present 
invention for use with a resistive-type touch screen assembly. 

Figure 3 is a bottom view of the post physical controller shown in Figure 

2. 

Figure 4 is a cross-section elevation of the post controller shown in Figures 
2 and 3. 

H 15 Figure 5A is a functional block diagram of the general electronic systems 

of the present invention, and Figure 5B is a partial block diagram of a further 
embodiment of a portion of the electronic system 

Figure 6A is a functional block diagram of the electronic components of an 
20 unmodulated switched embodiment of the present invention, Figure 6B is a 

functional block diagram of a modulated embodiment of the invention, and Figure 
6C is a functional block diagram of the electronic components of an unmodulated 
unswitched embodiment. 
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Figure 7 is a flow chart depicting the operation of the electronic system of 
the present invention. 

5 Figure 8 is a side elevation of a further embodiment of the present 

invention. 

Figure 9 is a cross-sectional end view of a further embodiment related to 
the invention as shown in Figure 8. 

10 

Figures 10A and 10B are graphs of voltage versus time for the signals used 
in the electronic system of the present invention. 
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Description of the Preferred Embodiment 

The present invention generally comprises a system for interactively 
operating with a touch screen system to signal the touch screen that a physical 

5 control device has been activated. With regard to Figures 2-4, a physical control 
device may comprise a post assembly 46 having a base portion 47 and a stem 
portion 48 extending coaxially therefrom. The base portion may have a diameter 
greater than that of the stem, and the bottom surface 49 of the base is provided 
with a releasable adhesive that is adapted to removably secure the base to the 

10 outer surface of a touch screen assembly. The outer end of the post assembly 46 
is a wider crown 51 that is also coaxially disposed with the stem and base portion. 

A salient feature of the post assembly 46 is a resonant antenna formed of 
an inductive coil 52 and a capacitor 53. The coil may be formed as a spiral 
winding of conductive wire disposed coaxially within an annular recess in the 

15 base portion of the post assembly, and the capacitor may be disposed within a 
cylindrical cavity within the stem 48. (Other coil layouts and capacitor 
placements may be used without departing from the spirit and teachings of the 
invention.) One end of the coil is connected to one lead of the capacitor 53 at 
point 54. The other end of the coil is connected to a conductor 56. The 

20 conductor 56 extends to a conductive annular ring 57 at the crown 51, and the 
ring 57 is isolated from the crown 51 by insulators 58 and 59. The upper lead of 
capacitor 53 is connected to the central portion 61 of the crown, which is 
electrically insulated from the ring 57. 
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It may be appreciated that any finger touch that extends from the ring 57 
to the central crown portion 61 will complete the circuit formed by the coil 52 
and the capacitor 53. As a result, such a finger touch actuates the coil-capacitor 
circuit as a resonant antenna 23, as is described below. Note that other forms of 
5 finger touch connection, such as a switch of any kind known in the prior art, may 
be used in place of the components 57 and 61 . 

With regard to Figure 5A, a touch sensing system 31 includes an antenna 
34 disposed at the periphery of the touch sensitive area 32 of a resistive-type 
touch screen, the antenna radiating EM energy at a predetermined frequency that 

10 is resonant with respect to the antenna formed by the coil 52 and capacitor 53 of 
the physical control device. The antenna 34 may comprise one or more turns of 
wire or conductor about the perimeter of the assembly 33, or any other 
configuration that is effective to localize the EM field to the touch sensitive area, 
and is tuned to the appropriate resonant frequency by use of a capacitor 42 

15 which may be connected in parallel or series with the antenna 34. The antenna 
34 is powered by a control circuit 41 , which in turn is controlled by the host 
computer. 

The apparatus of the invention includes one or more physical control 
devices 21 . Each control device includes a resonant antenna 23, comprised of the 
20 inductor coil 52 and capacitor 53 in parallel or series (Figure 5B) connection to 
form a resonant circuit having a frequency defined by the respective LC time 
constant. The antenna 23 receives EM power transmitted from the perimeter 
antenna 34 at the resonant frequency, and, when the finger touch connection 28 
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is completed as described above, re -radiates an EM signal at the resonant 
frequency during the OFF periods of the square wave signal of the perimeter 
antenna. 



5 Modulated Switched Control System 

With regard to Figure 6B, the modulated embodiment of the control system 
41 of Figure 5 includes a signal generator 71 , such as a square wave generator 
generating a signal at frequency f x in the megahertz range and modulated by a 
signal at frequency f 2 the one hundred kilohertz range from signal generator 70. 

10 The modulation is carried out by multiplying the EM signal with the modulating 
signal using a multiplier or mixer device 75. The signal is boosted by power 
amplifier 73, and fed through a tuning circuit 72 and to the perimeter antenna 34. 
The perimeter antenna 34 radiates an EM field and also acts to pick up the 
radiated EM signal from the resonant antenna 23 of any physical control device 

15 placed on the touch screen and activated by the finger touch of a user. 

An RF switch 80 is controlled by the EM signal square wave to switch 
connectivity of the antenna 23 between the transmitter 72 and a receiver circuit. 
The RF switch 80 must be synchronized with the transmitter such that it is in 
transmit-on when the transmitter is HIGH and receive-on when the transmitter 

20 signal is LOW. The received signal is fed through the receiver amplifier 76 and 
bandpass filter 74 to extract the kHz range modulated signal (f 2 ). The resulting 
signal is fed to a pulse regulator 79 and conducted to frequency counter 77 to 
count the kHz range pulses. When the physical device is touched the received 
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signal amplitude is increased because the antenna 34 receives the phase shifted 
modulated EM signal re-radiated from the physical device. This received EM 
amplitude modulation is detected as a device "ON" signal. The output of counter 
77 is fed to processor 78, and, if a valid "ON" pulse count signal from a physical 
5 control device is detected, a control device touch event signal is sent to the host 
computer 100. The processor 78 periodically clears the counter to prevent a bit 
overflow error. 

Note that the signals f x and f 2 are also fed to the processor 78 and counter 
77. Signal fj serves as a reference frequency for the counter, and signal f 2 serves 
10 as a reference frequency to count the modulation beats. 



Unmodulated Switched Control System 

With regard to Figure 6A, an "unmodulated" embodiment of the control 
system 41 of Figure 5 A includes some of the same components as the previous 

15 embodiment, and are denoted with the same reference numerals having a prime (') 
designation. The unmodulated system includes a signal generator 71', such as a 
square wave generator operating at frequency f { in the megahertz range. The 
signal is boosted by power amplifier 73' and fed through a tuning circuit 72' to 
the perimeter antenna 34. The perimeter antenna 34 radiates an EM field and also 

20 acts to pick up the radiated EM signal from the resonant antenna 23 of any 

physical control device placed on the touch screen and activated by the finger 
touch of a user on the finger touch connection of Figure 5B. An RF switch 80' is 
controlled by the EM signal square wave to switch connectivity of the antenna 
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23 between the transmitter and receiver. The RF switch 80' must be 
synchronized with the transmitter such that it is in transmit-on when the 
transmitter is HIGH and receive-on when the transmitter signal is LOW. The 
received signal is fed through the receive amplifier 76' and pulse regulator 79' 

5 and conducted to frequency counter 77 \ The counter also receives signal f t to 
act as a reference frequency for the counter. When the physical device is touched 
the received signal amplitude is increased because the antenna 34 receives the 
phase shifted EM signal re-radiated from the physical device. This increase in 
received EM amplitude is detected as a device "ON" signal. 

10 Note, for example, in Figure 10A, that the signal induced in antenna 23 is 

approximately 90° out of phase with respect to the square wave signal f 1? and the 
signal received by antenna 34 from the antenna 23 is 180° out of phase. Thus, 
when the RF switch 80' connects the receiver to the antenna 34, the receiver is 
exposed to the switched return signal shown in Figure 10B. 

15 The output of counter 77' is fed to processor 78' , and, if a valid "ON" 

pulse count signal from a physical control device is detected, a control device 
touch event signal is sent to the host computer 100'. 

Unmodulated Unswitched Control System 
20 With regard to Figure 6C, the "unmodulated" control system 41 of Figure 

5 includes a signal generator 7 1 " , such as a square wave generator operating at 
frequency f x in the megahertz range. The signal is fed through a tuning circuit 
72" and boosted by power amplifier 73", and fed to the perimeter antenna 34. 
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The perimeter antenna 34 radiates an EM field and also acts to pick up the 
radiated EM signal from the resonant antenna 23 of any physical control device 
placed on the touch screen and activated by the finger touch of a user. The 
received signal is fed through the receive amplifier 76" and to lowpass filter 82, 
5 and thence to pulse regulator (comparator/inverter) 79" and frequency counter 
77". When the physical device is touched the received signal amplitude is 
reduced because the physical device induces an EM load while being resonance- 
coupled with the transmitted signal of the antenna 34. This decrease in received 
EM amplitude is detected as a physical device "ON" signal. The output of 

10 counter 77" is fed to processor 78", and, if a valid "ON" pulse count signal from 
a physical control device is detected, a control device touch event signal is sent 
to the host computer 100". 

With reference to Figure 7, the system flowchart includes, after power ON, 
generating an EM field at frequency / l9 which is radiated by the antenna 34. 

15 Thereafter, the system detects the re-radiated EM field of any device antenna 23 
at frequency, using any of the techniques shown in Figures 6A-6C. If there is an 
EM field response, it is interpreted as a finger touch event, which is 
communicated to the host computer (PC or the like). If there is no EM field 
response, the system continues to transmit the EM field from the perimeter 

20 antenna and to detect any re-radiated field. 

The finger touch event on a physical control device may be interpreted by 
the host computer in any useful manner. As one example, the finger touch event 
may be used to determine that a physical control device is being operated, and 
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that all physical control devices should be turned ON, to the exclusion of other 
touch inputs to the touch screen. When the finger touch event ceases, the 
physical control devices are turned OFF and all other touch inputs to the touch 
screen are enabled. This arrangement avoids the possibility that operation of a 

5 physical control device may accidentally cause the activation of a virtual device 
displayed on-screen, or that a touch input directly to the screen may overlap the 
touch pattern of a physical control device and cause erroneous inputs. 

The response signal generated by touching the physical controller device 
may be correlated with a touch detection signal from the touch screen assembly 

10 to form a useful combined entry to the host computer system associated with the 
touch screen. For example, when a post 21 is first placed on a touch screen 32, 
the touch screen generates a touch detection at the point (or area) of placement, 
and the post generates a response signal as described above. The coincidence of 
these signals may be interpreted by the host computer system 79, for example, as 

15 an indication that the user has installed the post at a particular touch detection 
area. 

With regard to Figure 8, an alternative embodiment of the invention 
provides a pen or stylus 81 having a tip 82 adapted to stimulate a touch detection 
on a resistance-type touch screen 32 equipped with the control circuit 41 and 
20 antenna 34. The pen 81 houses a resonant antenna 23 substantially as described 
above, with a finger touch connection pad 28 on the outer surface of the pen. 
The touch pad 28 may be placed to be touched when desired by the user to enter 
a computer command (Finger Touch Event - ON) that is independent of the 
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touch detections of the touch screen 32. This embodiment permits the user, e.g., 
to enter a mouse click (or double click) while touching a defined area of the 
touch screen 32, thereby facilitating a computer entry task that has been 
problematic with touch screen assemblies. 
5 With reference to Figure 9, the pen 81 may be provided with a sleeve-like 

cover member 83 that is rotatably secured about the barrel of the pen, the sleeve 
83 including an opening sufficiently large to permit access to the touch pad 
connection 28. The cover 83 may be rotated to selectively protect and disable 
the touch pad 28, so that accidental mouse click inputs or the like may be 
10 prevented. 

It may be appreciated that the control circuit 41 may be connected not 
only to a host computer, but also to any sort of electronic device that is designed 
to be operatively associated with a touch screen. 

The foregoing description of the preferred embodiment of the invention 

15 has been presented for purposes of illustration and description. It is not intended 
to be exhaustive or to limit the invention to the precise form disclosed, and many 
modifications and variations are possible in light of the above teaching without 
deviating from the spirit and the scope of the invention. The embodiment 
described is selected to best explain the principles of the invention and its 

20 practical application to thereby enable others skilled in the art to best utilize the 
invention in various embodiments and with various modifications as suited to the 
particular purpose contemplated. It is intended that the scope of the invention be 
defined by the claims appended hereto. 
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